Papers with Filipino NLP
FilBench: Can LLMs Understand and Generate Filipino? (2025.emnlp-main)
Copied to clipboard
Lester James Validad Miranda, Elyanah Aco, Conner G. Manuel, Jan Christian Blaise Cruz, Joseph Marvin Imperial
| Challenge: | Despite impressive performance of LLMs on English-based tasks, little is known about their capabilities in specific languages such as Filipino. |
| Approach: | They propose a benchmark to evaluate LLMs across a diverse set of tasks and capabilities in Filipino, Tagalog, and Cebuano. |
| Outcome: | The proposed benchmark reflects the priorities and trends of research in the Philippines . it finds that several LLMs suffer from reading comprehension and translation capabilities . |
Batayan: A Filipino NLP benchmark for evaluating Large Language Models (2025.acl-long)
Copied to clipboard
Jann Railey Montalan, Jimson Paulo Layacan, David Demitri Africa, Richell Isaiah S. Flores, Michael T. Lopez Ii, Theresa Denise Magsajo, Anjanette Cayabyab, William Chandra Tjhi
| Challenge: | Recent advances in large language models (LLMs) have demonstrated remarkable capabilities on widely benchmarked high-resource languages. |
| Approach: | They propose a benchmark that systematically evaluates LLMs across three key natural language processing competencies: understanding, reasoning, and generation. |
| Outcome: | The proposed benchmark covers eight tasks covering Tagalog and code-switched Taglish utterances. |